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Abstract 

In this article we extend the idea of Turbo codes onto the Real Field. The channel 
is taken to result in block erasures and the only noise as being that due to quantization. 
The decoding in this case is reduced to reconstruction of the lost values. The encoding 
is done using critically sampled filter banks and introduction of an interleaver is found 
to reduce the mean square quantization error drastically. The permutation that gives 
the best recoverability is obtained in the 2 Channel case. Results are also obtained for 
M channel case. The algorithm for reconstruction of the lost values in the absence of 
quantization noise is obtained. 
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1 Introduction 



Novel communication and information services are being intoduced almost daily and de- 
mands for higher data rates and communication capacity continue to grow. This spectacular 
progress of communication is to a great extent due to consistent performance increase and 
cost reductionof the devices and circuit technology. Such advancements have also been fos- 
tered by major theoretical developments. The synergy components and signal processing 
techniques is considered to be the main cornerstone of modern communication equipments. 

Since Shannon established the fundamental limits on the transmission rates of a digital 
communication system and motivated the search for coding techniques that approach the 
capacity, various coding techniques have been proposed. Convolutional codes did better than 
block codes that formed the art of coding and cryptography. The landmark development 
in this regard has been by Berrou, Glavieux and Thitimajshima when they proposed turbo 
error control codeing over finite fields {GF{2)) by which the gap between the capacity limit 
and practically feasible channel utilisation is almost closed. 

In this article we to extend the idea of turbo codes proposed in p],j2] to codes over real 
fields. 

The plan of the article would be as follows. In Section 2, we introduce turbo codes over 
GF{2). In Section 3 we familiarise the reader with the techniques of frame theory and the 
theory of filter banks as convolutional encoders. In Section 4 we present our results on the 
encoding of real data using our turbo encoders. We compare them with normal oversampled 
filter banks and note the advantages. In Section 5 we present our results about the optimal 
permutation and also deal with M channel Encoders. Finally we conclude in Section 6 with 
a summary and a statement of some open problems. 

2 Turbo Codes over GF{2) 

Turbo codes exploit an idea of connecting two codes and seperating them by an interleaver. 
The primary achieve a low error rate with an overall decoding complexity lower than that 
of a single code of corresponding performance. The low complexity is attained by decoding 
each component seperately. As the inner decoder generates burst errors, an interleaver is 
typically incorporated between the two codes to decorrelate the received symbols affected 
by burst errors. Another application of concatenation is using a bandwidth efficient trellis 
code as an inner code or concatenating two convolutional codes. 

The difference between turbo and serially concatenated codes is that in turbo codes two 
identical systematic component codes are connected in parallel. The information bits for the 
second code are not transmitted thus increasing the code rate relative to a corresponding 
serial concatenated code. The primary reason for using a long interleaver in turbo codes is 
to generate a concatenated code with large block length which leads to a large coding gain. 
The decoder consists of two concatenated decoders of the component codes seperated by the 
same interleaver. The component decoders are based on max a posteriori (MAP) probability 
algorithm or a Soft Output Viterbi Algorithm (SOYA) generating a weighted soft estimate of 
the input sequence. The iterarive decoding process performs information exchange between 
the two component decoders. By increasing the number of iterations in turbo- decoding, a 
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bit error rate (BER) as low as 10 ^ to 10 ^ can be achieved at Signal-to-noise (SNR) close 
to the Shannon Capacity limit. 

2.1 Turbo Encoder 

A turbo encoder is formed by parallel concatenation of two Recursive Systematic Convolu- 
tional (RSC) encoders seperated by a random interleaver. Thus turbo codes are also regarded 
as Parallely concatenated convolutional codes (PCCC). 

2.2 Interleaver 

The interleaver in turbo codes is a pseudo-random block scrambler defined by a permutation 
of N elements with no repetition. The first role of the interleaver is to generate a long 
block code from small memory convolutional codes. Secondly, it decorrelates the inputs the 
two decoders so that an iterartive suboptimum decoding algorithm based on information 
exchange between the two component decoders can be applied. If the input sequence to 
the two components of the decoder are decorrelated, there is high probability that after the 
correction of some of the errors in one decoder some of the remainging errors should be 
correctable in the second decoder. In a pseudo random interleaver a block of N inputs is 
read into the interleaver and read out pseudo randomly. The pseudo random interleaving 
pattern must be available at the decoder as well. 

2.3 Decoder: Iterative Decoding 

Turbo codes can be decoded by MAP or ML decoding methods based on the overall code 
trellis. These decoders can be implemented for small interleavers only as they are too complex 
for medium and large interleaver sizes. The practical importance of tubo codes lies in the 
availability of a simple suboptimum decoding algorithm. 

The iterative turbo decoding consists of two component decoders serially concatenated 
via an interleaver, identical to the one in the figure. The first MAP decoder takes as input 
the received information sequence Tq and the received parity sequence generated by the first 
encoder ri. The decoder then produces a soft output , which is interleaved and used to 
produce an improved estimate of the a priori probabilities of the information sequence if the 
second encoder. 

The other two inputs to the second MAP decoder are the information sequence fo and 
the received parity sequence produced by the second encoder Y2- The second MAP decoder 
also produces a soft output which is used to improve the estimate of the a priori probabilities 
of the information sequence at the input of the first MAP decoder. The decoder performance 
can be improved by the iterative operation relative to a single operation serial concatenated 
decoder. The feedback loop is a distinguishing feature of the decoder and the name turbo 
code is given with reference to the turbo engine. 

After a certain number of iterations the soft outputs of both MAP decoders stop produc- 
ing further perfomance improvements. Then the last stage of the decoding makes the hard 
decision after deinterleaving. 
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3 Frames and Filter Banks 



3.1 Frames 

In this chapter, we define discrete frames and summarize a few of their properties. For a 
detailed treatment of frames and generahzed frames, the reader is referred to [SIjII]- 

We consider frames in K dimensional real space, i.e . A set of i^- dimensional vectors 
<l>^ = <^fc, /c = 1, . . . , iV is called a frame is there exist A> Q and B < oo such that 

A||zf<£|(z,^,)|2<5||zf (1) 

k=l 

for all z G i?^ 

where |(z,v3fc)| denotes the inner product of z and ipk, and || z || denotes the Euclidean 
norm of z. A and B are called the frame bounds. The inner product |(z,<y9fc)| gives the /cth 
frame expansion coefficient of z. Any finite set if vectors that spans is a frame. Therefore 
a frame will always have N > K. The ratio N/ K is normally referred to as the redundancy 
of the frame. 

A frame is called uniform if each frame vector has unity magnitude, i.e., || (^k ||= 1 for 
k = 1,2, . . . , N. The frame is associated with a frame operator F which is defined as 
follows: 

Fz=\{z,ipk)\ (2) 

for a\\k=l,2,...,N. 

Therefore the frame expansion coefficients of z are given by Fz. Using the frame operator 
F,the frame condition in eqn ]3.1l can be rewritten as 

A II z f < z*F*Fz <B\\z f (3) 

for all z G R^ where z*and F* denote the matrix transposes of z and F. It can be easily 
shown that the sum of the eigenvalues of F^F is equal to the sum of the squared lengths of 
the frame vectors. 

A frame is called tight if its bounds are equal, i.e., A = 5. Therefore $i? is tight if and 
only if F^F = AI^. This implies that the columns of F are orthogonal. In this case, F^F 
has eigenvalue A with algebraic multiplicity K. A frame is called snug if A ^ B. 

With N > K, Fz provides an over-complete expansion of the signal vector z. In this 
case, the frame vectors cannot be orthogonal and therefore the dual frame of $i? is required 
to reconstruct the vector z from its frame expansion coefficients. The dual frame ^of is 
another frame defined as <l>^ = <^fe,fc = 1, . . . , A^, where (pk = {F^F)~^(pk, ior k = 1,2, . . . , N. 
Since F^F is positive definite, it is invertible and hence the above definition is valid. It is 
easily seen that the frame operator associated with the dual frame is F = F{F^F)^^. 
Since F^F = (F*F)~^,the eigenvalues of F^F lie in the closed interval [1/5, l/A], and the 
bounds of $F are B~^ and A~^. Since FF = Ik, given the frame expansion coefficients of 
any vector z, the vector can be recontructed using the dual frame operator as follows: 

N 

z = F{Fz) = Y.{z,^k)^k. (4) 

k=l 

^It is also referred to as the reciprocal frame by some authors. 



4 



Among the frames, tight frames are the most imporatant since they possess some desirable 
properties related to reconstruction. The noise sensetivity of a frame depends on the closeness 
of its bounds. Small perturbations of the frame expansion coefficients can give rise to large 
reconstruction errors if the frame bounds are far apart. 



3.2 Filter Banks 

We consider an A^-channel Filter Bank(FB) with subsampling by the integer factor M in 
each channel, Perfect Reconstruction(PR) and zero-delay,so that x[n\ = x[n] where x[n] and 
x[n\ denote the reconstructed and the input signal respectively. The transfer functions of 
the analysis and synthesis filters Hk{z) and Fk{z) {0 < k < N — l),with corresponding 
impulse responses hk[n] and fk[n] respectively. In the oversampled case,(A^ > M), the 
subband signals are redundant, since they contain more samples(per unit of time)than the 
input signal. Oversampled FBs offer more design freedom, improved numerical properties 
and improved noise immunity as compared to critically sampled FBs. The increased design 
freedom corresponds to the fact that, for a given oversampled analysis FB, there exists a 
whole class of synthesis FBs providing PR. 

The polyphase decomposition of the analysis filters Hk{z) reads 

A/-1 

H,iz) = J2 ^"^fc.nl^""), 0<k<N-l (5) 

n=0 

where 

oo 

Ek,n{z)= E h,[mM-n]z-"' (6) 

m=— CO 

with 0</i;<A^ — l,0<n<M — lis the rath polyphase component of the fcth analysis 
filter Hi^{z).T\ie N x M analysis polyphase matrix E(z) is defined as [E(2;)]fc^„ = Ek^n{z)- The 
synthesis filters can be decomposed similarly. 

If we now consider subband signals Vk[Tn] corresponding to input signal x[n] and the 
reconstructed signal x[n\ and the perturbed subband signals f^fm] = Vk[m] + Affc[m] corre- 
sponing to the input signal x'jjym] = Xfc[m] + Axk[m] and the reconstructed signal a;'^[m] = 
XA;[m] + Axk[m]. Using eqn J3.1l and 5j, it can be shown that 

II At IP 

A < < B (7) 

II II 

where A, B are the frame bounds for the vectors Avk[m\ over ("^{Z). Thus for a given subband 
perturbation energy || Av |p, frame bounds A and B provide lower and upper bounds on 
the resulting reconstruction error energy.The reconstruction error energy is minimized by 
making A as small as possible and B ^ A. Thus it is desirable to have a snug frame. The 
frame bounds can also be related to the oversampling factor N/M. Normalizations give j3] 

A < -T77V7 < B. (8) 

- N/M - ^ ' 



For tight frames, corresponding to a paraunitary FB, we have A = B 



N/M- 
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Thus, the energy of the reconstruction error for given subband perturbation energy || 
Av IP is here inversely proportional to the oversampling ratio. 

For further details on the relation between frames and FBs, the reader is referred to 0. 



4 Codes over the Real Field R 

4.1 Filter Banks as Convolutional Encoders 

In this chapter we begin with our idea of iterative decoding if codes over the real field for 
robustness to erasures. Although this idea we believe can be generalised to two dimensions 
as well, such as for images, only the one dimensional case is dealt with in this report. We 
use rate ^ codes for encoding the data to begin with. Multirate (rate 1/M) codes are dealt 
with later. In earlier works jH],the use of oversampled filter banks for robustness against 
erasures has been studied. Although the connection between filter banks and convolutional 
encoders is obvious, there seem to exist only a few publications devoted to this sublect, see 
[7j,[Hj. The frame bounds are a crucial factor in deciding the reconstruction mean square 
error when the codewords are quantized. It has been shown [9J that if the encoding is done 
using uniform frames, the reconstruction mean square error is minimized if and only if the 
frame is tight. 

It is seen for DFT codes, in the case of cosecutive erasures, this value can be quite high 
[TT] . However, if the data is encoded using two encoders as in the case of turbo codes, 
significant improvements in perforamance were observed in [TI|. It was observed that the 
eigen spread of the resultant equivalent frame T,. was smaller. 



5 The Encoding Procedure - Rate 1/2 Codes 



Let the input sequence x{n) be blocked into vectors of size N (where N is the size of the 
interleaver) denoted by x, i.e., x = [x{0)x{l)x{2) . . .x{N — 1)]*. Let the output sequences of 
the filter xo{n) and xi{n) be combined into one vector y, i.e.. 



jV - 1 _ 1 ^ 

[xo(0)xo(l)xi(0)xi(l)xo(2) . . .xo(^— )xi(^— )]* 



(9) 



and the output sequences of the filter banks XQ{n) and x^(n) be combined into one vector 



K(o)xj(iK(oK(iK(2)...xj 



-)xr 



(10) 



2 / IV 2 'J 

We can then express the output y of the fiter bank as a linear transform T acting on the 
input X. If the analysis filters are causal and have length L, the matrix T is given by 



T 

-■- s 

T 

' 7T 



(11) 
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where 



ho{L- 
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ho{L - 2) 




-3) . 
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/ii(L-2) 


hi{L 
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. h,{0) 
















ho{L 
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. ho{2) 


ho{2) 


ho{0) 










hi{L 


-1) • 


. h{2) 


hi{2) 


hi{0) 



V 



(12) 



and n is a pseudo random interleaver. Tn is such that its ith row is the jth row of Tg where 

m=j- 

In the event of erasures the reconstuction mean square error is given by jE]: 



MSE^2 = aHrace{TlTry\ 



(13) 



where T,. is obtained at the receiver (decoder) after some rows from the matrix and the 
corresponding rows from Tn have been erased. 



Comments 

As a result of the arbitray nature of the interleaver it is not possible to calcultae the trace 
of the square matrix (T'T^)"^. Computer simulations were done for an interleaver size of 
150. It was found that trace(T*Tr)~^ is around five orders of magnitutde smaller than those 
obtained using oversampled filter banks in |H] . The reconstruction is possible for upto 2L — 1 
errors provided they are not in the first L — 1 rows of T^. This is because reconstruction 
is only possible if the remaining rows of T^ and Tn form a frame. Physically speaking, 
there should be enough redundancy in the signal left after erasures for reconstruction to be 
possible. Even though there were certain rogue permutations for which the improvement in 
trace in not so dramatic they are in the worst cases two orders of magnitude less than the 
oversampled case. As we know, the performance of Turbo codes is to a large extent governed 
by the exact permutation at hand. In this case however, the performance was found to be 
independent of the cycle length of the permutation and hence 11. It was also found that 
our procedure of encoding against burst erasures over erasure channels of the type normally 
encountered in multimedia signalling is better than that in [TTj . 

There are certain problems with the simulations though, of which one should be aware. 
The matrix ()12|) is bi-infinite. The simulations however use finite matrices and filters (in our 
case of length 9). As a result the orthogonality of the rows of T^ and Tn is not guaranteed. 
In fact for a filter of length L, the first and last L + 1 rows are not mutually orthogonal, 
while the middle N — 2{L ~ 1) rows are mutually orthogonal. These create some problems 
in the reconstruction which we address next. 



6 Reconstruction 

As we are dealing with codes over real fields, the conventional problem of decoding over 
GF{2) appears as the problem of reconstruction. The channel that we address is the erasure 
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channel and thus our task is to recover the values lost on transmission. The origin of noise in 
our case would be quantization. This has been a standard problem in Image processing and 
substantial amount of literature exists in that area. Of them we will choose one particular 
reconstrucion algorithm for our purposes. Prior to that however we have to ensure the 
recoverability of the maximum number of erasures. This is dealt with in the next section. 



7 Recovery 

In this context the best permutation is = i + N/2{modN), where is the interleaver 
size. We can always choose N to be even as it is in our prerogative. This particular problem 
of decoding over GF{2) appears as the problem of reconstruction. The channel that we 
address is the erasure channel and thus our task is to recover the values lost on transmission. 
The origin of noise in our case would be quantization. This has been a standard problem in 
Image processing and substantial amount of literature exists in that area. Of them we will 
choose one particular reconstrucion algorithm for our purposes. Prior to that however we 
have to ensure the recoverability of the maximum number of erasures. This is dealt with in 
the next section. In this spirit, we have the following theorem. 

Theorem l:The permutation = i + N/2{modN) can recover upto N consecutive 
erasures and no more when passed through the system given by Eqn ^| 

Proof: When the interleaver size is N it is evident that the matrix T is of dimension 
2N X N. When an information string of length is operated upon by this T, we obtain the 
the sequence in Eqn[TUl With slight abuse of notation we will label this sequence as y where 



Vn-i 
Vn 

y2N-i 
\ y2N J 



h,{L - 1) 


/io(L-2) 


h,{L- 


3) 


ho{0) 







hi{L-l) 


/ii(L-2) 


hiiL- 
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hi{0) 













ho{L- 


1) 




hoi2) 


hoiO) 








hi{L- 
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hi{2) 


hi{2) 


hi{0) 









1) hoiL~2) 




hoiO) 
















hoiL-3) 





(14) 



This will give us a set of 2N equations in N variables forming a consistent system. The 
nature of erasures considered are such that if i/i is lost then so is yi+N- However yi if it 
contains information about say t/q., at is a set of L integers from 1,2,. . . ,N, then yi+N has 
information about yoi+N- The sum is modulo N. As a result, after the loss of A^ of these 
equations, the remaining still form a system of A^ equations in A^ variables which can be 
solved to obtain the values of the coefficients Xi,X2, ■ ■ ■ ,xiy. 

Having proved that the permutation = i + N/2{modN) does ensure recovery of the 
maximum number of erasures which is possible in this case, i.e., N we try to devise a scheme 
for the rather unlikely scenario of being able to recover after more than A^ erasures from 2A^ 
samples. 



Xi 

\ Xn J 



8 



7.1 M - Channel Filter Banks 



Suppose now that we have to decompose the initial signal into a direct sum of M subspaces. 
We try to develop the matices analogous to (fT^ on the lines of §11. B. There will be 
M filters hi, i = 1,2, M — 1. They have to satisfy the basic requirement for projections 
onto orthonrmal and complete subspaces 



I. 



In that case the T matrix analogous to [121 will be given by 



M-l 
i=0 



(15) 



ho{L-r 

hM{L - 1 










/io(L - M + 1) 

hM{L-M+l] 
ho{L-l) 
h{L-l) 



ho{L 
hi{L 



2) 
2) 



ho{0) 

hoiO) 
ho{L-3) 
hi{L-3) 















ho{0) 
ho{0) 



V 



; : ■■• / 

(16) 

i.e., the subsequent sets of M rows are shifted by M each to the right. This system has the 
following as independent parameters: L, M and A^. To devise the 11 in the most general 
setting is a daunting task and is still an open problem. However, we will prove a couple 
of theorems for some special cases that in essence prove that M channel filter banks may 
indeed be better choices. 

Theorem 2: If the M channel filter bank is such that L = M and = rM for 
r G Z^, then the system can correct upto a maximum of 2{kM — 1) errors, such that 
{k - 1)M < N/2 < kM. 

Proof: From the matrix IT^ and applying the permutation n(z) 
we get 2N equations such that 

yi,...,yM } xi,...,xm 

UM+Ii ■ ■ ■ ■,y2M } Xm+1-, ■ ■ ■ ■,Xm 



i + N/2{modN) on it. 



(17) 



l/(r-l)M+l5 ■ ■ ■ 5 VrM } X(j._r)M+l^ • • • 5 ^rM 
VN+I, • • • , UN+M } Xn/2+1-, • • • , Xn/2+M 



y2N-M+l, 



y2N } Xn/2-M+I, 



^Xn/2- 



W.l.o.g, we can count how many erasures one can correct beginning from the first one. The 
channel is still such that if we lose yi then we loose yi+N- Find the k such that {k — 1)M < 
N/2 < kM, then it is evident that we can recover erasures upto {k — 1)M. To find if we can 
recover after more erasures, we see that we cannot recover if we loose upto kM as in that 
case there will be no equation containing at least xi. This can be seen as follows. When 
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we loose yi, . . . , i/kM, the loss is Xi, . . . , x^m- Correspondingly we also loose i/n+i, ■ ■ ■ , VkM+N 
whence the loss is .XAr/2+i, • • • , Since all sums are modulo and kM > N/2, 

{N/2 + kM) > 1. Hence we should at least leave one equation from the last set of M 
equations. Hence the number is kM — 1 out of A^. Thus it can correct upto 2{kM — 1) 
erasures in 2A'" symbols. 

We will be interested in the effect of the amount of channeling and its effect on recover- 
ability in the above scheme. We have the following result in that context. 

Corollary 1: With the above scheme, one can recover from more than half losses. 

If = 150 which is mapped to 300 points and for M = 4 = L, we can recover after 
a loss of 150 elements. For M = 8 = L, we can recover after a loss of 158 elements. For 
M = 16 = L, we can recover after a loss of 158 elements. For M = 32 = L, we can recover 
after a loss of 190 elements. 

Of course, this corroborates the fact that the longer the filter the better but since we 
assumed L = M, the structure will become unwieldy. Also computational complexity will 
be a challenge. 

In general L > M for all practical purposes. In this context we have another partial 
result. 

Theorem 3: If the M channel filter bank is such that L = 2M and N = rM for r £ Z~^, 
then the system can correct upto a maximum of + 2M errors. 
Proof: Similar to the proof of the last theorem we have 

yi,---,yM } xi,...,x2M (18) 

yM+l,---,y2M } Xm+1,---,X3M 
y{r-l)M+l, ■ ■ ■ , yrM 

yN+1, ■ ■ ■ , yN+M 

Z/2W-M+1, ■ ■ ■ , y2N } Xn/2-M+I, ■ ■ ■ , Xn/2+M- 

However we note that there are overlaps in the sequence. Any set of M x's appear twice in 
consecutive groups of |/'s each of size M. Hence using the argument of the previous Theorem 
we see that we can recover from more than kM erasures where {k — 1)M < N/2 < kM. Let 
A = N/2 — {k — l)M, then we can loose upto kM + A — M + N/2 elements and still recover 
the initial sequence. 

Thus from a sequence of 2A^ elements one can recover if there is an erasure of upto 
A^ + 2M elements. 

Comments 

The results of the last two sections prove the existence and recoverability of the initial 
information sequences fora variety of systems and provide the infrastructure to obtian results 
for a multitude of other systems. However the existence of recoverabihty does not the solve 
the engineering problem of decoding. What is needed is a synthesis Filter Bank that can 



} X^r-l)M+lj ■ ■ ■ 1 XrM+M 
} 2:^/2+1, ■ ■ ■ , XN/2+2M 



10 



recover the initial information string given any arbitrary pattern of erasures subject to the 
bounds provided by the above theorems. This is a formidable task and appears tough to 
solve in the present scenario. We however look at a simple algorithm that may provide the 
motivation for a reconstruction procedure. 

7.2 Alternating Projection Theorem 

The method of generalized image restoration by Alternating Orthogonal Projections was 
pioneered by Youla ^21- The concept of the method is very simple in mathematical terms. 
Given a Hilbert space Ti with elements /, g, h etc, a zero vector and an inner product, we 
consider an element f & Ti belonging to a known closed linear manifold(CLM) Vb- We are 
only given its projection g = Vaf onto the known CLM Va- The algorithm to reconstruct / 
from g is given by [12j as 

fk+i = g + QaVbfk (19) 

where Qa is the orthogonal complement of Q and Va is the orthogonal complement of V. 
The method always works in the absence of noise and in the presence of noise it works under 
certain restrictions on the nature of the noise and the from of V and Q. 

In our case we can use a projection like procedure. But as it turns out in the absence 
of any quantization noise, we do not need any recursion. Our algorithm get back the erased 
values in one run only. The manifolds in our case are as follows: 
Va- space spanned by the remaining (not lost) rows of T^, 
Vb- space spanned by the remaining (not lost) rows of Tn, 
Qa = V^\ space spanned by the lost rows of T.,, 
Qa = V^\ space spanned by the lost rows of Tn. 
We also note that either 

V^ C Vb (20) 

or 

Vi C Va (21) 

for any reconstruction to be possible. Then our recontruction relation is 

x = VaX + V^VbX- (22) 

where x is the information vector in Fig:4.1. In case Eqn: (5.3) holds the relation is 

x = VbX + ViVaX- (23) 

We actually work with the cofficients of the vector x rather than the vector itself for the 
sake of computational efficiency. Thus all we need to obtain on the RHS of Eqn: (5.4) are 
the coefficients of Vfj-VbX- The jth coefficient of Vfj-VbX can be given by: 

[Panx]j = (6„E(a;,e,)e,) = ^(x, e,) (6„ e,). (24) 

i i 

where bj span V^ and span Vb- 
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Once again due to the nature of the matrices and the spaces VaJ^b and their orthogonal 
complements, the reconstruction procedure cannot be verified analytically. Numerical sim- 
ulations agree with our predictions but there are certain problems. The bases hj and are 
not complete due to the finiteness of the matrix (fT^ . Hence we need to do zero-tailing and 
then look at the reconstruction. 

8 Conclusion and Open Problems 

Since the result of Shannon in 1948, the continued aim of mathematicians and communication 
engineers has been to design codes that approach the channel capacity. Block codes existed 
before Shannon and inspite of their beautiful mathematical structure, they failed to excite 
communication engineers except in a very few cases, like the Reed Solomon Codes. The 
emergence of Convolutional codes was more of an engineering solution to the challenge of 
attaining the capacity. Forney provided an algebraic structure and these codes went closer 
to the capacity limit given by Shannon. It was not until 1993 however when C. Berrou, 
A. Glavieux,P.Thitimajshima touched upon the Shannon limit asymptotically. Out of a 
computer search fell the Turbo codes. They were found to achieve the limit. However, lack 
of analytical results in this context dissapoint a lot of people with a mathematical bent of 
mind. It was evidently a dream come true for communication engineers. Berrou, Glavieu, 
Thitimajshima were quite right in developing turbo codes over GF{2). It was a natural 
question to ask if these codes can be extended to continuous fields. However, until upto 10 
years of the emergence of Turbo codes this question was not asked, lest answered. 

This has been the motivation behind this article. We have tried, in a small way., to 
develop the idea of Turbo Codes over R. This, we believe, will be a very active area of 
reasearch involving the concepts of coding theory, frame theory and signal processing. Each 
of these are huge disciplines by themselves. 

We have used techniques from these fields and some very basic mathematics to arrive 
at our results. Simulations have provided initial corroboration to our ideas. We have come 
up with some basic results proved in a limited setup. However these results can be used as 
stepping stones to obtain much deeper results about Turbo Codes over the real field. 

These ideas can also be extended to higher dimensional systems, in the least to the case 
of images, which is R?. We end with some of the open problems in this area : 

• To obtain the synthesis FB in 2 channel case for an arbitrary erasure pattern. 

• The behaviour of the code in the presence of Channel noise other than quantization 
noise. 

• To obtain general expression for maximum recoverability in M channel case. 

• To obtain the synthesis FB in M channel case for an arbitrary erasure pattern. 

• To explore the possibility of this scheme in the 2D case and obtain corresponding 
results as above. 
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